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Abstract 

In order to solve backward parabolic problems F. John [Comm. Pure. Appl. Math. 
(I960)] introduced the two constraints "||it(T)|| < M" and \\u(0) — g\\ < 5 where u(t) 
satisfies the backward heat equation for t e (0, T) with the initial data u(0). 

The slow- evolution- from-the- continuation-boundary (SECB) constraint has been intro- 
duced by A. Carasso in [SI AM J. Numer. Anal. (1994)] to attain continuous dependence 
on data for backward parabolic problems even at the continuation boundary t = T. The 
additional "SECB constraint" guarantees a significant improvement in stability up to 
t = T. In this paper we prove that the same type of stability can be obtained by using 
only two constraints among the three. More precisely, we show that the a priori bounded- 
ness condition ||u(T)|| < M is redundant. This implies that the Carasso's SECB condition 
can be used to replace the a priori boundedness condition of F. John with an improved 
stability estimate. Also a new class of regularized solutions is introduced for backward 
parabolic problems with an SECB constraint. The new regularized solutions are optimally 
stable and we also provide a constructive scheme to compute. Finally numerical examples 
are provided. 

Keywords: slow evolution constraint (SECB), backward parabolic problem, ill-posed prob- 
lem, Laplace transform 

AMS Subject Classes: 47A52, 44A10, 65M30 



1 Introduction 



One of the most classical inverse and ill-posed problems [12l EJ [23] is to find the past heat 
distribution u(-,t) for < s < T based on the temperature distribution u(-,T) known at the 
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current time T, which is formulated as to find u such that 
du 

— -Ait = onf!x(0,T); 

OS 

u{x,s) = V(x, s) G dU x (0, T); T) = g(x) ViGfi. 

The change of variables T — s = t yields to the problem 
du 

— + Au = onftx(0,T); (1.1a) 
u(x,t) = V(x,t) £ dQ x (0,T); u{x, 0) = g(x) VsGfi. (1.1b) 

Let —A be a second-order linear uniformly elliptic partial differential operator on a domain 
f2 with the homogeneous Dirichlet boundary condition on the boundary <9$7, which is a self- 
adjoint operator in L 2 (S7), such that —A has the eigenvalues < Ai < A2 < • • • < 00 with 
corresponding orthonormal eigenfunctions <j>nS. Problem (jl.ip generalizes to 

du 

— + Au = onQx(0,T), (1.2a) 
u(x,0) = g(x) VieO. (1.2b) 

The problem (|1.2j) is ill-posed in the sense that the solution does not depend continuously 
on the data g [T2], [131 [23]. To stabilize it, F. John [13] introduced a fundamental concept 
to prescribe a bound on the solution at t = T with relaxation of the initial data g. More 
precisely, given positive constants M and 5, consider the class of solutions Uj's which satisfy 



duj_ 

at 



+ Auj = on!]x(0,T), (1.3a) 



\\uj(0)-g\\<6 and \\uj(T)\\ < M. (1.3b) 
Then Uj : s satisfy the following Holder- type stability [H|23]: for any two solutions uj,j = 1,2, 

of cm, 

\\ui(t) - u 2 (t)\\ < 2M l l T 5 l - t,T for t G [0,T\. (1.4) 

where || • || denotes the L 2 (f2)-norm. The 5 on the right hand side of (|1.4j) guarantees continuous 
dependence on data for t £ (0, T). 

However, one loses the continuous dependence on data property at the continuation bound- 
ary (t = T) no matter how small a 5 is chosen, which has been annoying mathematicians and 
scientists for about three decades since F. John's work [13]. To overcome it, Carasso in his 
seminal works [21 [3] introduced an additional constraint, called a slow evolution from the 
continuation boundary (SECB) constraint, which is an a priori statement about the rate of 
change of the solution near the continuation boundary. The definition of SECB constraint is 
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discussed in (|2.ip and Definition 12.11 in §2. With an extra SECB constraint, Uj's fulfill the 
following improved stability over (jl.4p : 

\\u 1 (t)-u 2 (t)\\<2A t / T 5, t€ [0,2*1, (1.5) 

where A < M- is a positive constant. The three constraints, namely (|1.3bj) and an SECB 
constraint, have been used extensively and have proved usefulness for stabilizing ill-posed 
problems [H EJ EJ [7] . In [2] Carasso also provides a constructive scheme to find regularized 
solutions which can be implemented when A in (jl.2p has constant coefficients. 

In this paper optimal stability (11. 5p is proved by using the two conditions ||«j(0) — g\\ < 5 
and an SECB constraint only. In other words, we show that an a priori bound \\uj(T)\\ < M 
in (jl.3bjl is redundant. Also a class of new regularized solutions is introduced, which gives 
an optimal stability of the form (jl.5p . and can be obtained numerically even when A has 
variable coefficients, which will make the SECB constraints more useful and practical in many 
application areas. Applications of the above idea to image deblurring will be available in a 
forthcoming paper |17j . 

The rest of the paper is organized as follows. Section [2] reviews the concept of SECB 
and its properties. The new proof of the stability is then given in Section EJ In Section 0] a 
new class of regularized solutions is defined and its optimal stability is proved. In Section E] 
numerical results are reported with the proposed constructive algorithm. 



2 Slow evolution from the continuation boundary (SECB) 

In this section the notion of SECB and its properties are reviewed in brief. More detailed 
explanations and extensive applications of SECB can be found in [21 El HI EJ E]. 

Let us begin with the following simple observation. For given positive K, M, and 5 > 
with < K <C f, set s* = s*{5, M, K) to be 

log(4r - K) 

s*(S,M,K)=T * Ke } . (2.1) 
log(f ) 

so that = K + (^f) S / ' T . Set g(x,y) = 0. Then u\(x,y,t) = is a (trivial) solution to 
p.2p . and to (jl.3p . Let U2(x,y,t) be another solution to (jl.3p with an additional constraint 
— «2(i)|| = ||^2(*)|| = M l l T b x ~ l l T \ for example, U2(x,y,t) = Se xt (f)(x,y) satisfies such an 
additional condition provided A = ilog(^), where (j)(x,y) is an orthonormal eigenfunction 
of the spatial operator —A in (jl.3p with eigenvalue A, which mimics one of the worst case 
solutions to (OaD with the constraints (Obi) . Then \\u 2 (T) - u 2 (s*)\\ = \\M(f)(x,y) — (M — 
5K)(fr(x,y)\\ = K5; moreover, ||u2(T) — ^2(^)11 < K5 if and only if t > s*. Thus if an extra 
constraint on Uj(x,y,t) is imposed such that ||u,-(T) — u,-(s)|| < Kb for some s which is less 
than s*, a better estimation than that given in (jl.4p is expected. This observation leads to 
the following definition, firstly appeared in [2], 
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Definition 2.1. [Carasso (1994)] For given K > 0, let s* be defined by ()2. 1 j) . If there exists 
a known fixed s > s < s* such that 

\\ Uj (T) - Uj (s)\\ < K5, (2.2) 

Uj is said to satisfy "slow evolution from the continuation boundary (SECB)" constraint. 



Remark 2.2. Condition (|2.2[) implies that the class of solutions is restricted to satisfy the 
slow evolution condition near the continuation boundary t = T. 



Carasso then proves that any two solutions to (jl.3ap with constraints (jl.3b|) and (|2.2p 
have the following improved stability: 

Theorem 2.3. [Carasso (1994)] Letuj(t), j = 1,2, be two solutions to (ll.3ap with constraints 
(fl~3b|) and J22J). Then 

\\ui(t) -u 2 (t)\\ < 2A t/T 5, t G [0,T], (2.3) 
where A = A(K, s) is the unique root of the equation 

x = K + x s/T . (2.4) 
As for A, we have the following estimation. 

Lemma 2.4. Given 5, M, and K satisfying 0<k<I, 0<i-C<C^, and K + 1 < let 
s* be defined by (|2.ip . For < s < s* , let A = A(K, s) be the unique root of (f!T4"|) . Then 

M 

K+KA<—. (2.5) 
o 

Moreover, with any z\ > 0, the iterates z n +± = K + Zn , n = 1, 2 • • • , converge to A. 

Proof. Since H- is the root of (|2.4I) with s = s* by the definition of s* , and the root of (12. 4j) 



decreases monotonically with decreasing s, we have A < We also have iT + 1 < A since 1 
is the root of (12.41) with K = 0, and > 0. The last statement is a standard result of the 



fixed point iteration. □ 
Remark 2.5. Notice that the second statement of Lemma \2.4\ is slightly different from that 



given in JMj which states that K + 1 < z\ < This will play an important role (t 

Remark\3.4\) in our analysis. 



see 



Since A is less than M- by Lemma 12.41 Theorem 12.31 shows an improved stability estimate 
compared to (jl.4p . Moreover, this retains its continuous dependence on data even at the 
continuation boundary t = T. 
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3 \\u 3 (T)\\ < M is redundant 

In this section we prove (|2.3|) by using one condition ||tij(0) — g\\ < 5,j = 1,2, in (|1.3bj) and 
the SECB condition ([23]) only. 

Theorem 3.1. For given data g £ L 2 (S7), let Uj(t), j = 1,2, be two solutions to 



du 

with constraints 



-t+A Ui = on n x (0, T) 
at 



\\uj(0) - g\\ < 6 and \\uj(T) - Uj{s)\\ < K5 (3.1) 
for known positive parameters 5 > 0, K > 0, and s £ (0, T). Then 

\\ Ul {t) - u 2 {t)\\ < 2A t/T 5, t G [0,T], (3.2) 
where A = A(K, s) is the unique root of the equation (12.4p . 

In order to prove the above theorem, we will need the following preliminary result to 
bound ||z(s)||: 

Lemma 3.2. Let z(t) be the difference of two solutions Uj(t),j = 1,2, to (jl.3ap with con- 
straints (13. If) . Then, for < s < T, we have 

2 I 



\z(s)\\ 2 < 



2Kb 
T-s 



) + j2z 2 n (l-X 2 n )e 2X - s (3.3) 

' 71=1 



where z n = (z(0),(/> n ) with the standard L 2 {Q)-inner product notation (•,•) and I > and 
I > is the largest integer such that A; < 1. 

Proof. Since z(t) is the solution to (|1.2|) with initial data z(0) = u±(0) — U2(0), it admits the 
following representation^: 



z(t) = Y,Zne Xnt <p n - (3.4) 

n=l 

By and @3J, 

oo 

||z(T) - Z( S )|| 2 = £ 4( e AnT _ e A„ S) 2 < ( ^ )2> (3 5) 



n=l 



1 Notice that the assumption on the existence of the solution Uj{t) for t € (0, T] implies that ||uj(T)|| < Mj 
with a possibly different bound Mj > for each j. Thus || 5H^Li z„e Xnt (pn | 2 < S^Li | (iti (0) , <j> n ) — 
(Mi(O),0„)| 2 e 2A "' < 2Er=i{l(^i(O),0n)| 2 + |(^i(O),0 n )| 2 }e 2A " T < 2(M X 2 + M 2 2 ). Thus @3| forms a con- 
vergent series. 
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where 5 = 25. By the mean value theorem there exists s n (s < s n < T) such that (e XnT — 
e XnS ) = X n (T — s)e x " s " for each n. Therefore, utilizing s < s n , from (|3.5p it follows that 

oo 

^z 2 n X 2 n (T- S ) 2 e 2X - s <(K5) 2 . (3.6) 

71=1 

By dividing both sides of 433) by (T-s) 2 and replacing J2n=i+i z W XnS by J2n=i+i 4e 2AnS , 
a rearrangement yields 

E 4e 2X " s < (^] 2 - E «e 2 *»'. (3.7) 

n=Z+l V / n=l 

Finally by adding both sides of (fH7T|) by X^ =1 £ 2 e 2AnS , implies that 
lk(*)H 2 = E 4e 2A - < (^-) 2 + E 4(1 " A 2 )e 2A -. 

n=l V 'V n=l 

This proves the lemma. □ 
Remark 3.3. /// = 0, we interpret X^n=i as 0- 

Now we are in a position to prove Theorem 13.11 
Proof, [of Theorem 13. lj Let z(t) = ui(t) — U2(t) and note that (see [T| [T5]) 

< [k(r)||^||^(o)f-^, te[o,T}. (3.8) 

Let <5 = 25. By (|3.ip and the triangle inequality, we have 

||z(0)||<$ and \\z(T) - z(s)\\ < K5. (3.9) 
By (|3.8p . the triangle inequality, and (|3.9p . we have 

||*(t)|| < (II^CO-^WII + lkWID'^No)!! 1 -*/ 3, 

< (^ + ||z(s)||)'/ T 5 1 ~*/ T , t€[0,T]. (3.10) 
Due to Lemma 13.21 there exists an upper bound (j > for K5 + ||z(s)|| such that 

K5 + \\z(s)\\ < (i. (3.11) 

Then, (|3.10p implies that 

\\z(s)\\ < Ci T 5 l ~ s/T - (3.12) 
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If Ci is a sharp estimate such that (i = Kb + (I 5 1 S//T , then d/5 is the unique root of (|2.4p ; 
in this case, set A = (i/5. Otherwise, we have a successive estimate for Q2 such that 

K5+ \\z(s)\\ < C2 < K5 + Ci /T ?~ s/T 
by using (j3. 12[) in place of in ()3.1ip . A division of this by 5 gives 

/ ~\ s/T 

( 2 /5<K+(Ci/5) . 

Again if £2 is a sharp estimate such that (2 = K5 + 8 1 ~ S ^ T , then £2/^ is the unique root 
of (|2.4p ; in this case, set A = ^2/^- Otherwise, continue this iteration which results in 

( n /5 <K+ (Cn-i/8) 

for n = 1,2,3,- •■ . Consequently, a standard fixed point iteration argument implies that 
% < A, where A is the unique root of (12, 4p . Thus, invoking (|3.10j) . we arrive at 

\\z(t)\\ < (A5)*/ T 5 1_ */ T = A*/ T 5, (3.13) 
which completes the proof. □ 

Remark 3.4. In JI[/ ; The constraint ||u,-(T)|| < M was used to bound Ci in (13. lip . However, 
with any (1 > ; i/te iimii point of the sequence [Cn/Sj is bounded by A (see Lemma \2.J$ , 
and thus the use of M in f^j is not essential provided £1 is bounded by some constant, which 
is proved in Lemma \3.%\ . 

Remark 3.5. An emphasis has to be made: the constant s* € (0, T), which depends in a 
priori bound M as well as 5 and K, is not a requirement in Theorem I3.il 

Remark 3.6. Notice that in (13.3|) the right hand side goes to infinity as s — > T '. Thus, if 
s = T (it means we do not have the SECB constraint), we may not bound ||z(s)||, and therefore 
(13. 2p may not be proved, i.e., the SECB constraint actually guarantees continuous dependence 
on data in place of \\uj{T)\\ < M. 

Remark 3.7. For some M, K > and < 5 < 1, let s* be such that f- = K + {^f) s * l T . 
The following three cases should be considered: 

1. In the case of the SECB constraint with s = s* , the unique root A of (12. 4p becomes 
Thus by Theorem[3J\ we have \\z(t)\\ < 2A t ? T 5 = 2M t / T 5 1 ' t/T as in (TOD. This means 
that the SECB constraint is indeed so general to include the case in which the F. John's 
bounded constraint \\uj{T)\\ < M is used. 
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2. In the case of s < s* , one can use the SECB constraint which will lead to a substantial 
improvement over the F. John's a priori estimate (jl.4p . 

3. However, in the case of s* < s < T, the stability estimate (13, 2p might be worse than 
that (H3D. 

Combining these facts, the knowledge of an a priori bound in (|1.3b|) will be still useful for an 
exact computation of s* that will guarantee a choice of s < s* . 

Remark 3.8. It should be emphasized that even in the case that the a priori bound M in 
(|1.3bp is not used and thus s* is not exactly given, the SECB constraint (|3. 1 j) will provide the 
stability estimate (|3.2j) which guarantees the continuous dependence of the solutions on the 
initial data up to the boundary t = T. 



4 A constructive regularized solution 

In this section we propose a new regularized solution to backward parabolic problems based 
on the observation in the previous section. 

Let g G L 2 (Q) be given initial data. Suppose < (S < 1, K ^1 and s G (0, T) are given. 
Then with the A which is the unique root of (|2.4p . choose an appropriate contour V C p{— A). 
For instance, following |16t I25j. for suitable 7,1/, and a, let 

7 — V 1 v2 + V 2 + *°*2/> with increasing y from — 00 to + 00 1 , 

where A is the unique root of (|2.4|) . (4.1) 

Although one does not have a precise information on the exact eigenvalues of —A, there will 
be a finite number of eigenvalues which are strictly less than ^SM^, Let Ai, • • • , Ajv be all such 
eigenvalues. Also, denote 

$r = span{0i, • • • , (f> N } C L 2 (fT) 
and let Ilr : L 2 {VL) — > <3?r be the _L 2 (f2)-projection. For Ujo G L 2 (£l), define 

u T ' u i°(t) = — f e zt v(z)dz, (4.2) 
2vri J T 

where v = v (z) = v(-,z) G H^(fl) is the unique solution to 

zv + Av = Uj , z G p(-A). (4.3) 
Formally, the vF ,u ^° can be written as 

u r,u j0 (t ) = J_ f e zt( zI + A)-^ dz. (4.4) 
2vri J T 



r 



{z = z(y) I z(y) = 
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Observe that Uj = u r,u i° satisfies 

du ■ 

-^- + A Uj = onnx(0,T). (4.5) 
Define the class of new regularized solutions by 

{ Uj = n r '^° | u T ' u i° is defined by (OJ) and \\u j0 - g\\ < 6, \\uj{T) - Uj {s)\\ < K5} (4.6) 

Notice that the integrands of two Cauchy integrals (|4.2p and (|4.4p can be written as the 
infinite series YlkLi z -\ k ( u j0> 0fc)^fc- Among them only a finite number of terms from fc = 1 
to k = N are to the left of the contour T, and the rest of infinite terms are analytic in the left 
half plane. Thus the Cauchy integrals (|4.2p and (j4.4|) are convergent. Indeed, we have the 
following spectral reprentation formula: 

Proposition 4.1. The spectral representation ofu r,u i°(t) is given by 

N 



L r ^(t) = J2e Xkt (u j0 ,<p k )<p k . 



k=l 



Proof. By taking the L 2 (f2)-inner product of both sides of (|4.3p against fa, one gets a spectral 
representation of v{z) by 

v ( z ) = Y] 7~( u jo, fa) fa- (4.7) 

k=i z ~ Xk 

Since N is the largest integer such that < -^M^ and Ylk^N+i z -\ k ( n Q' ^k)^k is analytic in 
the half plane left to T, by incorporating (|4.2p . (|4.7|) . and Cauchy's integral theorem, we have 



r,n, 0(t) = — V / -^(u j0 ,fa)fadz 

1 N f e zt N 
= 27ri$Z J r ^^^^ u ^^k)fadz = s ^e Xk \u jQ ,fa)fa 



k=l L k=l 

This completes the proof. □ 

Due to the definition of u r '" j0 , the same stability estimate as (j3.2|) follows. 
Corollary 4.2. Lei vF ,Ul ° and vF ,U2 ° be new regularized solutions. Then, 

\\u r > uu, (t) - u r ' U20 (t)\\ < 2A f / T 5, t £ [0,T\. (4.8) 
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Proof. Since 



u 



r,uio 



(0)-u 



T,n20 



(0)1 



n r «io - n r -u 2 o|| < ||«io - «2o II < s, 



the estimate (|4.8p is an immediate consequence of Theorem 13.11 



□ 



Remark 4.3. The implementation of the above regularized solution can be given as follows. 

1. Given 5, K, s, solve for A satisfying (|2.4p . 

2. Choose a contour V as in (|4.ip . 

3. Deform the contour V as a hyperbola, parabola, or Talbot contour with parameter to be 
the imaginary part. (See, for more details, J25\, fffPl 

4- Represent the infinite contour as a graph of a function on a finite interval, on which 
choose composite trapezoidal points. (Again refer to J25\, [2R \27^ .) 

5. Solve a set of complex-valued, Helmholtz-type problems (|4.3p for such finite number of 
contour points, by any kind of space discretization methods (e.g. finite element method, 
spectral method, etc.) 

6. Take a discrete sum of such solution to approximate the contour representation of the 
solution given in (|4.2p . 

This type of procedures, called "Laplace transformation method for parabolic problems", have 
been proposed and analyzed for forward parabolic problems, in f2~4[ {EM 0, [HI G21 G21 E3 
\2b\ rjU ESI E21 EE Wtf , integro- differential equations fl4\ E2F and backward parabolic problems 

5 Numerical examples 

In this section, we try to find regularized solutions which are members of the class defined in 
(|4.6p . and illustrate the behavior of them. We construct the solutions following the steps in 
Remark 14. 3 1 for the following backward parabolic problem: 



where Q = (0, tt),T = 4, and c = 1/32. Let the piecewise linear solution at t = T, which 
should be sought, given by 



Ut + cu : 



XX 



U 



on Q x (0, T) 
on (917, 




( 16 



< x < | , 
— < r < — 

4 — x — 2 ' 

otherwise. 



U(;T) 



< 
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The following truncated series solutions 

sin(A;x)e- cfc2 ( T -*) (5.1) 

are used for the reference solutions uq(x), u(x, T/4), u(x, T/2), and u(x, 3T/4). 

Let s = 3.8. Based on the information on uo, we fix K = 0.142/5 for given 8. 

To find solutions u r,Uj0 in the class ()4.6p . initial data Ujo are generated by perturbing 
the above truncated series solution uq{x) = u(x, 0) given by (|5.ip using the Fortran 90/95 
intrinsic subroutine random_number(-) so that ||ujo — Soil < 8 f° r $ = 10~ 4 , 10~ 3 , 10~ 2 . 
Then the solutions n r ' Uj0 (x,t) are approximated by using the standard piecewise linear finite 
element with sufficiently many element (1024 meshes) and the Laplace transformation method 

on the deformed contour T = lz(y) = j(5,s,K) — \J v 2 + y 2 + iy, y € [— oo,oo]| in (|2.4jl is 

used, where v = 0.5 and -y(8, s, K) ~ 2.583, 2.067, 1.074 for 5 = 10~ 4 , 10" 3 , 10" 2 , respectively. 
In all experiments 160 number of contour points Zj S clXG chosen which will be sufficient to 
circumvent the numerical errors in time discretization. 

Table Q] shows the L 2 errors of u T ' Uj0 to the reference solutions and the theoretical upper 
bound values 2A t ^ T 5, as given in Corollary S3] for each 5 = 10" 4 , 10" 3 , 10~ 2 . Notice that the 
L 2 errors of n r ' nj0 are much smaller than the predicted bounds for all cases. To check vF' Uj0 
is in the desired class, we calculated \\u T ' Uj0 (T) — u r,Uj0 (s)\\ values, which are 0.0568,0.0623 
and 0.208 for 5 = 10~ 4 , 10~ 3 , 10~ 2 , respectively. They are less than Kb = 0.142 except for the 
case of 5 = 10~ 2 . When 5 = 10~ 2 , we tried to generate a solution in the class by introducing 
several but not so many enough number of different random noises to no avail. However, 
even though the initial data is not in the class if it is near, the L 2 errors are smaller than the 
expected bounds, and thus the quality of the solutions shown in Figure 1 are acceptable for 
all cases including when 5 = 10 -2 . 



t 


L 2 -errors with 5 = 10 4 


L 2 -errors with 5 = 10 3 


L 2 -errors with 5 = 10 2 


Computed 


Predicted 


Computed 


Predicted 


Computed 


Predicted 


T/4 


4.25E-05 


1.61E-03 


2.96E-04 


9.59E-03 


7.82E-03 


5.86E-02 


T/2 


3.18E-04 


1.29E-02 


1.20E-03 


4.59E-02 


2.39E-02 


1.71E-01 


3T/4 


4.65E-03 


1.04E-01 


6.85E-03 


2.20E-01 


7.38E-02 


5.02E-01 


T 


1.48E-01 


8.33E-01 


1.50E-01 


1.06E-00 


2.72E-01 


1.47E-00 



Table 1: L 2 errors of our regulared solutions and those of prediced in the theory are shown 
for 5 = 10" 4 , 10~ 3 , 10~ 2 . Here s = 3.8. 



Table [2] and Figure 2 are for s = 3.9. The L 2 errors of n r ' nj0 are again smaller than 
the predicted bounds for all cases. With s = 3.9, the \\u r,Uj0 (T) — n r ' Uj0 (s)|j values are 



u{x,t) = 



J c(kir) 



2 sin 



3kir 



sin 



kir\ 



sin(/c7r) 
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Figure 1: Exact and computed solutions at t = T with various <5's and s = 3.8. 



0.0568, 0.0623 and 0.2110 for 5 = 10~ 4 , 10" 3 , 10" 2 , respectively. We observe that they are less 
than Kb = 0.084 except for 5 = 10 -2 . As in the previous case with s = 3.8, for 5 = 10 -2 , 
we tried to generate a solution in the class by introducing different random noises, but it 
failed. It also should be noted that the I? errors are also smaller than the expected bounds, 
which implies that the quality of the solutions shown in Figure 2 are acceptable for all cases 
including when 5 = 10 -2 . 
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